Plundermatics: Real-time Interactive Media Segmentation for Audiovisual Analysis, Composition and Performance

This paper presents methods for real-time automated media segmentation, interactive audiovisual analysis, and media search in composition and performance tasks. In addition, we detail a use case where these tools have been deployed successfully as part of high profile public, national broadcast events, installations and exhibitions. These tools utilise a combination of data-mining and information retrieval approaches, automated sound and image segmentation techniques, and fast real-time audiovisual interaction technologies to create user-navigable media search environments, where users explore large sets of audiovisual data in fast, engaging and intuitive ways. This work is supported by the Arts and Humanities Research Council.